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ABSTRACT 


This thesis presents a method for indicating, during the 
developmental phase, reliability levels attained amd the proba- 
bility of achieving a svecified reliability goal, The results 
from developmental tests are used, as contrasted to the more 
prevalent practice of testing for reliability demonstration at, 
or near the conclusion of development. A significant advantage 
is thereby available to management and the designer by reducing 
time and expenditure in the decision making process, Technically, 
this procedure is based on a principle of a posteriori probability. 
This requires an assumption of an a priori probability distribution 
which is then modified by test results, according to Bayes' Theoren, 


to yield an a posteriori probability distribution, 
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1, Introduction 

It is becoming increasingly prevalent for a reliability figure 
to be specified for a system prior to the design and development of 
the equipment. This means that the developer must build the equip- 
ment so that its probability of satisfactory operation be at least 
as high as the specified goal, 

Specification of a reliability figure as a goal implies that 
the attainment of this figure must be demonstrated. In many 
instances, this demonstration of reliability is a contractual 
obligation. 

In order to demonstrate reliability by conventional sampling 
procedures subsequent to development, extensive testing at con- 
siderable cost in time, money, and materials is generally required. 
This cost may not be economically feasible for such expensive 
programs as ballistic missiles, 

The delaying of the determination of the reliability level 
until after development would extend the time required prior to the 
inception of production and could negate a majority of the past 
development effort if the reliability goal is not achieved. A 
demonstrated reliability level falling short of the goal will 
necessitate a re-examination of the design, require a re-develop- 
cnt, and follow with another testing period. Such a long feedback 
loop for decision making is intolerable. Consequently, a product 


less reliable than desired may be accepted. 





A method that would progressively demonstrate the reliability 


level attained, concurrently with the developmental program, is 
desired. Such a method could utilize the results of developmental 
testing, and thereby reduce the costs of testing solely far the 


purpose of measuring reliability. 











2. Probability, a priori and a posteriori 

A definition of probability can be given in several ways but 
the following classical definition of probability will suffice at 
this point. The probability that a specific unit possesses a 
certain attribute is defined to be that proportion, q, of the units 
possessing the attribute within the entire population of units. 
Thus, from a knowledge of the composition of the population, it is 
possible to compute the probability that a particular composition 
will occur in a single randomly drawn sample. Such Seale 
that is, probabilities determined from the classical definition, 
are called "a priori" probabilities, 

| A somewhat reverse situation exists in the case of "a posteriori" 

probabilities, All that is known is the composition of a randomly 
drawn sample. The technique used in this paper assumes a probability 
distribution for the unknown q_ based upon experience ard sound 
engineering judgment. This assumed distribution is referred to as 
an a priori probability distribution. A conditional distribution of 
q given the outcome of experiments (i.e., test results or sample 
values) is then computed, This conditional probability distribution 
of q is known as the a posteriori distribution of q, and proba- 
bilities computed from this distribution are called a posteriori 
probabilities, The technique is sometimes referred to as a Bayes! 
principle since Bayes' formula is used in comouting the conditional 


probability distributions. 








3. Use of Developmental Testing 

For eaoh level of reliability there is a minimum number of 
successful tests required. This number varies with the number of 
test failures experienced as well as the confidence level associated 
with the statement of reliability. It is also evident that the number 
of successful test results needed depends on the a priori assumption. 
When an optimistic a priori distribution is assumed, the number of 
successful tests required is reduced accordingly. This may appear 
at first sight to be a very unsafe procedure. However, it will be 
shown by the operating characteristics of the procedure that there 
is a low probability of achieving a successful count unless the actual 
system reliability is as good as or better than the required level, 

The purpose of this paper is to propose a method that uses the 
knowledge gained from developmental testing to indicate the relia- 
bility of the equipment at each stage of its development. It also 
will make it possible to ascertain when, and if, a specified system 
reliability has a reasonably good chance of being achieved. From 
this information, the criteria for re-examination of the current 
design can be formlated. If the reliability of the current design 
is low or the probability of this design reaching the specified 
reliability level is low, redesign or modification is indicated. By 
having this reliability information concurrently with each step in 
development, the designer will be able to improve his product at an 
earlier stage, thereby shortening the feedback loop and ensuring 
earlier achievement of the desired goals. As a consequence of better 


feedback, the number of tests required will probably be reduced. 





duction in tests is a savings in money, time, and 


material. There is a variability in the amount of testing required 


depending on the actual reliability of the equipment. The higher 


the actual reliability, the smaller the amount of testing required. 








lh. Comments Concerning Sequential Sampling 

It has been suggested that standard sequential sampling plans 
be used as a method of reducing the sample size required to demon- 
strate a specified reliability level. The method proposed here, 
while being of a sequential nature, differs in several important 
ways. Sequential analysis, such as that which might follow develop- 
ment, includes criteria for accepting or rejecting the system. The 
proposed method can be used concurrent with development and does not 
"reject", but indicates the reliability level attained and the proba- 
bility of achieving the specified reliability goal. 

The sequential analysis technique appears to be best applied to 
product improvement programs. Unfortunately, several missile mam- 
facturers, after completing development, have found that they have 
produced an unreliable missile, The purpose of the proposed method 
is to avoid this contingency by providing management and the designer 
with reliability "milestones" during development. A very important 
advantage of the method is that it does not require equal amounts of 
testing on all components. Extra testing is concentrated on compo- 
nents indicating inferior reliability. Subsequent test results of 
these components may, by this procedure, be integrated with test 
results of other components in the system to demonstrate achievement 


of the overall system reliability. 








S. The Distribution Function 

Let p be the proportion of the population of systems under 
consideration that will be successful, then q = 1 - p will be the 
proportion that will fail. 

For this population of systems, there exists some single value 
of q. Since this value is unknown, an a priori distribution of q 
values is assumed. This is equivalent to treating the failure 
proportion as a random variable, one 

Assume that a typical a priori distribution, f,(q), of Q is 
the Beta distribution characterized by two parameters, A and B, 


where A is associated with successes and B with failures, Then: 


p(y= ["(A+B+2 ) ; py 


(1) (Att) [ (Bt! 
Cd ok ae, DN A>O 
MCT API MG LaD q) t B-| 


with its mean given by 
oe 
its mode by 
1 Sale sae 
and its variance by 


oe a (At! YBt! cee 
(A+B+2 )*(AtBt3) 


See Appendix IV for mathematical derivation, 


1 A random variable may be defined to be a function which 
associates a real number with every possible outcome of 
an experiment according to some probability law. Con- 
ventionally, a random variable is designated by a capital 
letter and any value of this random variable by a small 
letter. In this case, Q is a contimous random variable 
defined on the interval 0 ¢ q < 1. 


( 








The Beta distribution is particularly adaptable to Bayes! 
Theorem since the a priori distribution function (a Beta 
distribution), when modified by experience (success and/or failure), 
results in an a posteriori distribution which is again a Beta 
distribution. Besides this desirable property, the various forms 
of the Beta distribution are sufficiently inclusive to represent 
realistic distributions of Q. This distribution varies from the 
uniform distribution where A = B = 0, to the extremely skewed 
distribution where A >> B, A > a When A >> B and A>? 1, the 
Beta distribution can be approximated by the Gamma distribution, 
For a system whose reliability is high, the distribution of Q mst 
necessarily be very skewed. To demonstrate such reliability, one 
should expect the number of successes to be large and much greater 
than the number of failures, Therefore, the Gamma distribution 
function becomes a realistic approximation to the Beta distribution 
and will be used, The benefits from this approximation will become 
more apparent in the subsequent sections. 

If A 77 B and A 77 1, the values of the parameters of the 


distribution can be approximated as follows: 


Kt 


a) a oy a 


=~ VBt! 
OG, A 


: The symbol >> means "much greater than", 





If S successes and F failures are obtained in N independent 
trials of a system whose failure probability q is a number fran a 


population of Q assumed to have an a priori probability density 


f,(q), then a posteriori probability density f,(q) is given by: 


(3) = RGIICS pg’) 
hg Jo LKGICS prg"]ay 


which reduces to an expression identical with that for f,(q) in (1), 





except that A is replaced by A + S and B by B + F, In particular, if 
S >> F, the mean and standard deviation of the a posteriori 
distribution, using (2), are approximately: 


~ + | 
Mg = BHF El 


(4) A+S 


Gs Veer del 
t~ ~A+S 


(See Appendices I through IV for the mathematical derivations] 











6. Confidence and Reliability 

Classically, the concept of confidence is based on results of 
observations made on elements of a population. It is a statement 
of the degree of assurance one has in a statement about a parameter 
of the population. In this paper, a priori "confidence" is an 
assumption in the farm of an a priori probability. After observing 
the results of testing, this confidence is modified in an a posteriori 
probability and correspondingly an a posteriori confidence. 

With each statement about q, the unreliability, there is an 
associated confidence. This confidence is improved as one gains 
more knowledge about the distribution of Q. 

let any fixed value of Q, say q,, be the maximum allowable 
system failure probability. Then the probability of Q < qq can be 


evaluated by the integral: 


Bc 
(5) ij fulg) dg 


This is the probability that the q of the system is included in 
the interval zero to q,. This q is a number from a population of 
numbers distributed a priori by f,(q) and a posteriori by fx(q). 
This probability is the confidence, in view of the a priori proba- 
bility distribution and test results, with which it is stated that 
the desired reliability has been attained. This incomplete Beta 
function (5) will be evaluated by an incomplete Gamma function using 


the same mean and standard deviation given by (lh). 


10 








Let z = Aq 


2 
a Livit, fulg) lg = SS 
and 
pet iz 5 
(6) OL (2) = | Fer 
In general 


I 


(7) Prob. {Q< de} x (Z,) 
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Using the Tables of the Incomplete Gamma Function, it is possible 
to determine the value of z corresponding to a given B for different 


levels of confidence. (See Appendices VI and VII for details). In 
Figure (1), the plot of B vs. z is presented for 50%, 70%, 80%, 90%, 
and 95% confidence levels. 

As an example of the use of this chart, assume that you have 
experienced 20 successes and ), failures and wish to make a statement 
about the system's reliability with a 90% confidence. Entering the 
chart with B = 4, you read z = Aq = 8, from which q = .l. Therefore, 
you may state that the system has a reliability of .6 or better with 
the confidence that a statement of this sort will be correct 90 times 


out of 100, 








7. Assumption of Initial Values 

It should be noted that the proposed method permits a certain 
amount of subjectivity on the part of the experimenter. His selection 
of a particular a priori distribution function of Q reflects the 
degree of optimism with which he views the design. As was mentioned 
previously, any optimism should be the consequence of design experience 
and sound engineering judgment. 

When a reliability goal has been set for the system, a specified 
value q, is established. Consider the case when the mean, fea of 
the distribution of Q is equal to qe and the distribution is spread 
so wide that the standard deviation is also equal to qee 

According to (2), this requires that the initial values of the 


parametérs must be: 


A- 4g. Ne 
A ?7 8 
b= O 


This means that a priori there is about 70% assurance that Q < ay. 


(8) 


In effect, this assumption credits the design with | successes 
toward demonstration of the reliability goal. However, even with 
this advance "credit", the probability of an unreliable system 
reaching the goal by chance alone is quite small. Section 9 on the 
Operating Characteristics curve (0.C. curve) illustrates this point. 

To further investigate the effect of assuming some initial value 
for A, consider A = te and A = a. The effects of these biases are 


simularly exhibited by the 0. C. curve. 


12 








8, The Demonstration Walk 

Now the question of how many system test successes are needed 
before there is reasonable assurance that the failure probability 
Q is less than some pre-assigned qd. can be answered. 

Two different graphical presentations are found convenient to 
answer this question. With the number of failures versus the number 
of successes as coordinates, it is possible to plot a family of curves 
for either constant values of q, or percent levels of confidence. 
These two types of presentations are illustruted by Figures 2-2.5 
and 3-3.5 respectively. 

As the experinenter records the test results on the q, curve 
graphs (Figures 2-2.5), he performs a type of "random walk", Starting 
at the ieee the walk moves one unit upward for each success and 
one unit to the right for each failure, When the walk reaches one of 
the a lines, the system under development has demonstrated the 
reliability associated with this curve. 

Referring to Figure 2, consider the following illustrative example. 
Assume that the assigned reliability goal is .80, This fixes the In 
at .20. Figure 2 shows that a minimum of 12 successes without failure 
is required to demonstrate the specified reliability goal, If only 
one failure is experienced before 12 successful tests have been 
conducted, the required number of successes increases to 20, Similarly, 
the number of successful test results far any number of failures can 


be determined, 


NG 








Next, let one consider the second type of presentation as 
exemplified by Figures 3 through 3.5. In this type of chart, the 
family of curves for several percent levels of confidence are 
plotted for a given oe value. 

After the reliability zoal has been established and the 
development program has begun, management will be interested in 
knowing how development is progressing with respect to the established 
goal, This type of chart provides a graphic display of the degree of 
confidence which can be ascribed to certain figures of reliability. 

As an illustrative example, consider Figure 3, Assume the 
reliability goal is .80 or q, = .20. Further assume that 10 
successes and 1 failure have been experienced. From the chart, it 
is seen that there is more than 50% confidence of .80 reliability or 
better. If an additional 18 successes and another failure were 
subsequently recorded, the confidence would be increased to over 90%, 

“Next, consider the effect of letting A = =. and B= 0. Since 
Ic * -20, the walk would begin with A = S. This means that a priori 
there is about 70% assurance that the system is .80 reliable, If now 
ten actual successes and one actual failure were observed, a confidence 
level of about 80% has been indicated. In this manner, assumption of 
the initial values for A and B reduces the amount of tests required 
to demonstrate a reliability goal. However, reduced sampling increases 
the risk of a system demonstrating a reliability level when, in fact, 
it isn't that reliable, The Operating Characteristics curve is a 


graphic presentation of these risks, 


Ui 








Thus, poster size charts can be maintained on which test results 
are plotted in a step-by-step, random walk fashion as illustrated by 
the arrows in Figure 3. These charts can become powerful management 
tools for predicting reliability trends, for maintaining reliability 
"milestones", and in general, for monitoring overall reiiability 
progress, 

(The table of values used in the construction of Figures 2 


through 3.5 is included in Table 2 of Appendix IX.) 
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9. Operating Characteristics 

The operating characteristic of the procedure is defined as the 
probability of attaining the number of successes needed to demonstrate 
a specified reliability, (1 - a)» as a function of actual reliability, 
(1 -q). Actually, the probability is treated as a function of the 
ratio x = a/o where q is the actual unreliability and q_ is the 
specified unreliability. 

If the reliability is high, (x << 1), it is desirable to have 
a high probability of attaining ths satisfactory number of successes, 
On the other hand, if the reliability is low (x > 1), it is desirable 
to have a small probability of a satisfactory count. 

Now consider the computation of the operating characteristics, 
Let Ay denote the number of successes, actual and constructed, required 
to demonstrate the specified reliability when i failures have occurred, 
For zero failures, i = 0, the probability of achieving Ay successes 
is p Ao or (1 - ae”, since p = (1 -q). The probability of attaining 


A, successes, experiencing no more than one failure, is written as: 


Ao A 
(1-4) + Ao 4 (I-§) 
Letting L (qa) be the probability of attaining the required number of 


successes to demonstrate a given reliability, a more general expression 


would be: 


L(g) = (1-9) + Ag (1-9) + [Aol Ar Aor!) 
(An!) JaXting 
+AatAanl | 4'( q ) +. 
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The successive terms represent the probabilities of satisfying the 
required number of successes when failures, F, = 0, 1, 2, ------=. 
By letting 23 = Ay q, and x = @/4.» and applying a limiting 


process as q,->—-0, the expression (9) becomes: 


- 2K - -7,% 
(10) LG) = ee "4 [2.(2,-2,) + 25, ]x’e : Ti 


The computation of L (q) when considering larger number of failures 
becomes very laborious. In fact, the number of terms in z that form 
the coefficient for the exponential function increases by the power 
of two, This means that if one desires the probability of achieving 
the required number of successes having experienced no more than ten 
failures, the coefficient of the term in L (q) associated with ae 
would have 512 terms in z, instead of 2 as in the last term of (10). 
If L_ (a) is extended to consider 1l failures, the additional 
coefficient, would have 102]; terms in 2. From this, it is clear that 
manual computing is impractical, (See Appendix VIII for details, ) 

The evaluation L (q) up to 15 failures has been completed by 
use of an electronic digital computer. In order to evaluate the 
expression for 15 failures, 200 minutes of Univac 1103A machine 
computing time were utilized. (For a detailed discussion of the 
essential machine computing techniques, see Appendix X. 

Figures through 5.43 are operating characteristics (0.C.) 
curves plotted from the results of the machine computation, From 
these charts, one can determine the risk of having a system demon- 
strate achievement of a reliability goal when, in fact, the system 
is below the specified reliability. The charts will also show the 


effect on this risk of assuming initial values for A and B, 


of 











For example, consider Figure 4, which displays 0. C. curves 
for the 90% confidence level, Representative curves are plotted to 
illustrate how L (q) varies with observed failures. The curves 
plotted are for three sets of assumed values for A and B and three 
failure conditions, 

The risk of having a below par system accepted as having attained 
the reliability goal is the probability wnen x > 1. When x >? l, 
the actual q is greater than the specified Gee Figure h shows that 
this risk varies from .13 to .33 for O through 15 failures for the 
unbiased condition. 

The effect of the assumption of initial values for A and B is 
clearly indicated. As would be expected, the probabilities are 
inersased as the bias is increased. Figures 5.11 through 5.13 
present a range of curves for 70%, 80%, 90%, and 95% confidence levels. 


Fach chart displays three bias conditions. 
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10. Components 

One should next extend this model to the counting of successes 
and failures of components for a system. Suppose that a system is 
to contain n independent components, no one of which is known a priori 
to be definitely more reliable than the others. Therefore, we shall 
assume the same a priori probability distribution for the failure 
probabilities Q), Q9, ----, Q,, of the n components. This distribution 
is of the form of (1) with the parameters A and B to be specified 
subsequently. The choice of these parameters, like the earlier choice 
(8), will be dictated by an a priori distribution, i.e., a subjective 
opinion of the system as a whole, 

Let 4 denote the probability of failure of the qth component, 


i=l, 2, ----, n, and q denote the system failure probability, then: 


(1) g = | ~ TT (I-4) 


ie 


Since the individual component failure probabilities must be very small 


in order to achieve high reliability, (11) may be approximated by: 


(12) .= Git Gat Gst eee Gn 


Also, it is pointed out that formla (12) holds in cases where it is 
realistic to assume that system failure results from one and only one 
component failure. In this case, no assumption is made ~>.-arding 


independence of components. 
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From (2) and (12) it follows that the a priori distribution of system 


unreliability, Q, has a mean: 


on [y= pa op = Res) 


and a standard deviation: 


me % oe V(Bt1) 
(14) | Oe = = i a Samm 


Assume, as was done in deriving (8), that the a priori distribution 
of Q has a mean at q. and a standard deviation also equal to dee Then, 
from (13) and (14), it is seen that one must choose: 

A= 


(15) B a eee 
nN 


It is worth noticing that this means, according to (2), the individual 
component failure probabilities q; have an a priori distribution with 
mean of the order yuan =e Accordingly, the standard deviation 
oa, = Ic, though emall, is not of the same order of smallness as 
Mi: This a priori assumption about components, which weights the 
extremes (q close to 0 and q close to 1) more heavily than the distri- 


bution indicated in (8), is necessary in order that the a priori 


distribution of the overall system shall not be concentrated closely 


around its assumed mean, Vee Such a concentration would certainly 


be unjustified a priori. 





Now that the a priori component distribution parameters A and B 
have been chosen according to (15), the a posteriori distributions 


th 


are found as before. Thus, if tests of the 1°” component have 


yielded S, actual successes and F, actual failures, the a posteriori 


distribution Q, is characterized by: 


A; = 79. + Si 


ait ne | 
ee - oF a 


thus yielding a mean 


sia Toe 
(17) 4 at Se 


and a standard deviation 


(18) OG; = it Fi 
4g, t Oi 


The a posteriori distribution of system failure probability Q then 


has a mean; 


Var Fi 
a Per =) te 4qet di 
and a standard deviation 
(20) Oz =a Sat EL 
BO] (4 Si)? 


el 








Making a change in variables and considering the limiting case 


as in deriving (7), one may write: 


(21) ol (Z,) -[& (B+ Se ds 


where ‘the B is the single parameter of the system and is associated 
with failures in the system. B, is the number of failures (actual 
and constructed) in the ith component. The relationship between B 


and B, is the following: 


i 
n 
> (B+!) = Bt 

(22) 2={ 


n 
“B=p-it>. B; 
rea 
Substituting the a + banal B, from (16) leads to: 


YB, = YA -(n-l 
(23) a [Er —(n-1)] + (n-1) 
1 B= > Fi 


This is a very important relationship because it permits the 
integration of component test results to demonstrate system reliae- 
bility. Therefore, the proposed method is readily adaptable to a 
developmental program, where each component designer may be conducting 
separate tests, The system reliability can be computed at any time 
during this separate testing phase, If all components have been 
subjected to an equal amount of tests, the determination of the 


parameter B is simply the sum of all failures experienced by each 
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of the components, It is unlikely, however, that all components 
will have been tested equally. It is then possible to compute a 
conservative lower bound to the reliability by disregarding, for 
the — the number of successes over the minimum number recorded 
for any one component. Similarly, an optimistic, upper bound can 
be computed by using the maximum number of successes experienced by 
any one component as the number of system successes, 
Example: Consider a complete system of 3 components which 
| have been undergoing separate testing programs, 
The following results have been observed: 
Component A : 2¢ successes, 1 failure 
Component B : 26 successes, 1 failure 
Component C : 2k successes, O failure 
Referring to Figure 2, the upper and lower bounds to 
a system reliability are computed as follows: 
Upper (26 successes, 2 failures) : qs 220 
Lower (22 successes, 2 failures) : q, = 025 
Therefore, one may state with 90% confidence that 
the system reliability, at this stage of the 
development, is in the interval .75 to .80, 
The preceding discussion has assumed that the development of all 
components of the system progresses simultaneously. Im practice, 
however, it may be found that while the development of most compo- 
nents is proceeding in step, several components may be far behind. 
It is not necessary to wait for these "stragglers" to reach the same 


State of development before indicating system reliability. 
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In the example, consider the case where componsnt A has not been 
tested and the test results of component B and C are as indicated. 
Again from Figure 3, the indication is that system reliability, 
based only on components B and C, is about .85. From this, manage- 
ment can reason that if the development of component A is as satis- 
factory as that for components B and C, the system reliability will 
be in an interval around .85. At some subsequent time, the results 
of tests with component A can easily be combined with those of B and 


C, to yield a modified system reliability figure, 


2k; 











ll. Expected Number of Tests 

For pianning purposes, it is desirable to determins the number 
of tests one should expect to conduct in order to demonstrate attain- 
ment of the reliability goal, 

Since this method is "one-sided", in that there is no "reject" 
criteria, the expected number of tests required for rsliability demon- 
stration increases as more failures occur, Therefore, in order for 
an expected number of tests to be calculated, the number of failures 
to be considered must be specified, For example, one must ask, "What 
is the expected number of tests one must conduct in order to demone 
strate achievement of the reliability goal if no more than 'k! failures 
are observed?" 

Because one assumption throughout has been that the number of 
successes is much greater than the number of failures, (A >7 B), 
the number of successes is essentially the number of tests. Letting 


N equal tho expected number of tests, one may write: 


(24) N =A +A, A+....+ Avstes + Ax [I4R+ ieee Pei) 


which ig the number of successes required to reach the "index" curve 
for a specified Go multiplied by the probability of achieving this 
number of successes. Recalling that 2; = Asay it is convenient to 


rewrite (2) as: 


(25) GeV = Zofo + ZA eee R..+[I-(P,+P+...+R.,)| 


en 





ee 


In (2h) and (26), the probabilities Py, Pj, Pp, .... PF are the 


values of the term of the L.(q) expression that is associated with 


the number of failures denoted by the subscript. 











For any given confidence and assumed value for A, which determines 
the value of the zy, equation (25) can be plotted versus the ratio 
of actual to specified unreliability, x = q/q,g. Figure 6 is just 
such a graph. The figure is for the case where A = O and a 90% 
confidence level. 

Figures 6.1 and 6.2 are for the same confidence but illustrate 
the effect of two different assumed values of A on the expected 
number, N. 

To show how N varies as the x ratio, the assumed value of A, 
and the number of failures vary, the following table has been 


prepared from the data displayed by Figures 6 through 6.2. 


So ee ee ey ey 


EXPECTED NUMBER OF TESTS FOR dg = 20, 90% CONFIDENCE 








x = a/de 
= = 1.0 x = 20 
A 
: O | 1/2q¢ | 1/a¢ 1/24¢ | 1/d¢ O | 1/2qa¢} Wace 
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CURVES FOR DETERMINING NUMBER OF SUCCESSES 
REQUIRED AT A SPECIFIED CONFIDENCE FOR SEVERAL UN- 
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CURVES FOR DETERMINING NUMBER OF SUCCESSES 
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APPENDIX I 
THE GAMMA DISTRIBUTION 


The function 


£(q) = sry 4s Age T rad >o 
4 (Ly Per aye P(e +1) % 


is called the Gamma distribution. This is a two parameter family of 
distributions, the parameters being A and B. A must be positive and 


B must be greater than -1. The function is plotted in the Figure 


below for A = 1 and several values of B, 





Changing A merely changes the scale on the two axes, as is evident 
by examining the form of the function. For example, if A =10, B #0 
intercept on f(q) axis for q = 0 is 10 and at q = .l, f(q) = 3.678. 


To show that the function has a unit area, we shall evaluate the integral: 


i < CA B+! we dq 


Ds 





letting Z = qA, dZ = Adq 
CL = * 2 edz 
Hence CL is a function of B only. If A> O we may integrate at once 


by parts to obtain 
Ge)= 8 (ze * de 
It then follows recursively that 
a.(8)= B A(e-1) 
If B is a positive integer, we may evaluate Cl by 
Q.( 8) = B(8-!)(B-2)---(2\') Bt) 
and since 
Blo) = (* edz = | 
it is found that 
ais) = 8} when B is an integer 


The function B! is often denoted by | ' (B + 1). 


The cumlative distribution function is 

Ge Aor 

"A oe & Ag, G70 
O Pies) 8 


O 4 <9 


(4) 


When A is a positive integer, the function can be evaluated by 
successive integration by parts 
F(qys\ ~ L+qAt3 (gals. d gare >0 
with 2 = gA 
=\-\\+2+ 2 2°79 2? >o 
(z)=\-L) bi +---+5,- le - 





APPENDIX ITI 


THE BETA DISTRIBUTION 


The distribution function 


£ - (A+B +2) 
M(A+I) FP (B+!) 


A 8 
(\~ 4) 4 ONGC I 
(1) 


= 0 elsewhere 


is called a Beta distribution function. The function represents a 


two-parameter family of distributions. A few examples are plotted 


in the Figure below. 





60 





The distribution becomes the uniform distribution over the unit 
interval when A = B = 0, 
To show that the area under f(q) is unity, we shall compute the 


integral 


(2) CLia.8) = { (-4) q dg 


Clearly, CL will be a function of A and B. One way to demonstrate 
this is to show that (L is the reciprocal of the constant multiplier 


in (1). In the discussion of the Gamma function, it is shown that: 


(tera) (Jy? e Vay) 
we xy ee Ax diy 


C(A+i)C(B+t)= AB! 








let us make a change of variable by letting Mh = =i yy 
ULK 
\—- mM 


from which 
days on (\— er 


since OG). < | the integral becomes 
| Be Ske 
ALK (i=) XX 
rrarin(art) = { (Far) we OY A ee 
© /o 
Now let X—>WV by the substitution 


Ye (l-ew)w 


dx = (i -w)dV 


6) 





from which 


Math (B+1) ‘ ( A me 2 daw dar 
Oo ° 


( (pfs ev dv) ("ae uh du) 


© 


= (A+B8+1)} (uP (Vay dae 


TM(A+I)PC B+ 1) | yp B 

s 

°° TIAt+ B42) care ba dae 

This shows that Ch (A, B) is the reciprocal of the constant multiplier 
for (1). ( (A-1, B-1) is called the Beta Function in the literature. 


The cumulative distribution, the incomplete Beta function, is: 
F(q) 20 dO 


$e (A+ B+2) AB 
a PCA+I)E (Bt) OP EO <7 


=a F >! 
Extensive tabulations of this function can be found in Karl Pearson's 
"Table of the Incomplete Beta Function", Cambridge University Press, 
London, 1932. 

The moment generating function for the Beta distribution does 
not have a simple form. This fact makes the use of the Beta distri- 
bution for determining system reliability through combining the 
component distributions very impractical. It will be noted that the 


Gamma distribution is ideally suited for the purpose, 
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APPENDIX III 
REPLACEMENT OF BETA DISTRIBUTION BY THE GAMMA DISTRIBUTION 
The a posteriori distribution of q was determined to be the 
Beta distribution function fy (q), where 


T(A+B+2) A 6 
( = _ 
Sy %) M(A+1)P(B+1) ( %) % 
From Stirling's formula 
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In the limiting case, as A-~» 0, this reduces to a single parameter 


family, with B as the parameter 
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where 
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which is a form of the Gamma distribution that is discussed in another 


ul 


section of this Appendix. 
One advantage resulting from the replacement of the Beta distri- 
bution with the Gamma distribution, is the ease of combining several 


distributions of the same kind. While several Beta distributions do 


not combine to form another Beta, the sum of several independent: Gamma - 


distributions gives. another Gamma, 
This is evidenced by considering the moment generating function 
of the Gamma distribution 
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, where Z, has incomplete Gamma 
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distributions with single parameter By, it follows that 
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which is of the same form as ab 
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APPENDIX IV 


CALCULATION OF THE MEAN, MODE, AND VARIANCE 
OF THE BETA DISTRIBUTION 


The equation of the Beta distribution being 


_ P(A+B+2) _ 
f, )= M(A+1)P(B+1) .! % 4 


the following calculations determine 


(1) Mean: 


Peg = E(4) = = (A+ B+2) ( -4) 4 "dq 
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(2) Variance: 
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APPENDIX V 
BAYES! THEOREM 
An understanding of the use of Bayes! theorem is important to 
the complete understanding of the proposed method. A single example 
illustrates how the Bayes' relationship is used to modify an a priori 
distribution to give an a posteriori distribution. 


A statement of Bayes' theorem as used in this paper is: 
; f (4) C p> +. 
Baio, ¢ 14% 


Let one assume that the a priori distribution f(a) is uniform 


between 0 and 1. It may be pictured as follows: 
Fg) 
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Let one further assume that after one success has been observed, we 


apply Bayes' formula: 


{ @)s (\) (pe) (i= 4) =Z(i-4) 
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This a posteriori distribution may be pictured as: 
£(q) 
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From this one observation, the Bayes' relationship has modified the 
a priori distribution from uniform to a bias in favor of the value 0. 
This is an intuitively reasonable result since no failure was ob- 


served. If the single observation had been a failure, the a posteriori 


would have been biased to q = 1 like this: 
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If the outcomes of two observations were one success and one failure, 


the a posteriori distribution function would be: 


{ (@) _ gg) = (Cal 
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which can be pictured as follows: 
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This a posteriori distribution function is a parabola, having been 
modified from the a priori uniform distribution. That the value 
q = $ is most heavily biased is reasonable, since we have observed 


an equal number of successes and failures, 
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APPENDIX VI 
DETERMINATION OF VALUES OF Z 
The Tables of the Incomplete ["- Function are used to determine 
the walue of z for any given confidence level and any given numer of 
failures. 


Equivalent notation required for use of the table is as follows: 


e8) Tree oe. 

Vpeu 
(2) p = B where B = number of failures 
(3) I(u, p) = confidence level in decimals 


As an example of use of the [’ Function tables, consider the 
determination of z given 5 failures and a 90% confidence level. With 
p = 5, find the value of u corresponding to the tabular value I(u, p) 
= .9000000. Interpolation is necessary to find u = 3.7873. Using 


the relationship given by (1), one finds: 


7 = u\p +1 
= (3.7873) (2.495) 


Se .ett 

In the plotting of the 0. C. curves, three sets of assumed 
initial values of A were investigated. These assumed values of A 
were introduced by subtracting either 4, 1, or 2 from the value of z, 
when A = 0, 

Consider the case with A = O for a 90% confidence level and 
failures equal to two, From Table 1 one finds that z = q A » 5.326. 
However, if the assumed value for A = 1/q,, then the a posteriori 


expression becomes 


ze 








and multiplying both sides of the equation results in 
= i = . 
a," de (S, ‘ Ge. G54 7 1 5.326 


or 
qo54 > 4.326 


Therefore, when the a priori assumption is A = a. the z used in 
Ae 


calculations is the value of z for A = O minus one, 


In a similar manner, when the assumption is A * = or A wé P 


2 
the assumption is effected by subtracting a Ori2, aseecety. ” 
from the value of z when A = 0, 
Appendix Vilcontains Table 1 which presents the values of z 
when A = 0. The values listed are for the 50%, 70%, 80%, 90% and 


95% confidence levels and 0 to 15 failures inclusive, 
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APPENDIX VII 


TABLE 1 


Values of Z (A = 0) 


50 
0,69), 
1.678 
2.67 
3.672 
4.671 
5 669 
6,668 
7.670 
8,66), 
9,669 

10,671 


11.670 


12,671 
13,670 
14.6721 
15.670 


Confidence Levels 


70 
1,20) 
240 
Bor 
4.673 
5.892 
7.008 
8,116 
9,211 

10.303 
11.38), 
12 72 
13 0549 
1,626 
15,696 
16.768 
17.835 


1.601 
2.995 
4.23 
50518 
6.730 
7.908 
9.078 
10.23h 
11,382 
py Pay20) 
13.659 
14.780 
15.899 
17,018 
18.126 
19,216 


90 
2.302 
3.891 
52326 
6,68 
7.996 
90277 

10,535 
11.775 
12,999 
1,208 
15.412 
WS Bly 
iy aioe 
18.963 
20.128 
21.297 


95 
2.996 
4.76 
6.298 
7.756 
9.15y 

10.514 
11..8h5 
alse 
Us 0436 
15.710 
16,961 
18.214 
19 oluk5 
20.67 


21,894 


23.102 





APPENDIX VIII 
DEVELOPMENT OF L. (q) EXPRESSION 

A curve determined by a given value of q, can be plotted on a 
graph of successes vs. failures. Then for each value of Failures, i, 
there exists a number of successes, A, that is required to demon- 
strate the specified q,. 

A "walk" can intercept this q, curve at only integral values of 
i. Let L-(q)q be the probability of hitting the q, curve at i 
failures not having hit the curve pefene i failures. 


L.(q) is the sum of the L(q)4 terms which are as follows: 


A 


Ligle= pe 
et ar |craee| Sil - C "qe" z= Nog. os 


pete ge ery PT 
Liq), a io4 ee AS Bennie bch a vi Aang 
{erga eee eh 
+[crg eer gi ger] pee 


® . 
e @ 
¢ 


=) 
ch 





Simplifying, these expressions result in: 
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and consider the limiting case as Qo 0. 
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For the first term, the approach yields 
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Similarly, the successive terms may be considered to yield: 
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It is apparent that evaluation of |_(q) becomes laborious as we 
consider more failures. For the results plotted in this paper, 
an electronic digital computer was used. 

Appendix X presents two computing techniques that are 


peculiarly associated with this problem. 
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TABLE 2 
Number Minimum Number of Successes Required 
Io of Confidence Level 
Failures 50 70 80 90 95 
005 0 13069 2.1 32560 eee 5959 
i 33.6 48.8 59.9 79.8 9h.9 
2 53.5 | (2. 859° 10aes5 12650 
3 7304 95.2 110.4 133.7 155.1 
h 93.4 118.0 134.6 159.9 183.1 
5 113.4 140.2 158.2 185.5 210.3 
6 133, 162.6 181.6 210.7 236.9 
7 153.4 184.2 204.7 235.5 263.1 
8 173.4 206.0 227.6 260.0 288.7 
9 hoje 227.0 25060 20ee site? 
10 213.4 249.4 273.2 308.2 339.2 
bee 233.4 271.0 295.6 330.3 364.3 
12 25304 293.0 318.0 355.7 388.9 
210 0 GIG 1256 1650 °23.0 ‘30.50 
it 16.8 2h.) 30.0 39.0 7.5 
2 20,0 36052 t2clk 5353 63.0 
3 Scams litso  S5e2 6650 77.6 
4 6.7 59.0 67.3 80.0 91.5 
5 56.7 70.1 79.1 94.8 105.1 
6 66.7 81,3 90.8 105.5 118.5 
7 76.7 92.1 102.3 128.0 131.5 
8 6605 103.0 112358 130.0 Lshoh 
9 96m oe 12366 125.2 1h2.0 157.2 
10 106.7 124.7 136.6 154.0 169.6 
11 MiGey 13505 15758) 16555 182.1 
12 126.7 126.5 159.0 177.5 194.5 
5 0 ie B,0n) 10,7 melo. «6©6- 20,0 
1 M162 1663) 20205 26,0 31.7 
2 ye Zl 2063 35500 2.0 
3 Pic ele 93050 “eo 8651.7 
rn BiG? A39oS els? 5303 “611 
5 37.8 6.7 52.7 61.9 70,0 
6 UboS Shol 60.6 70.3 79,0 
7 S182 «61.h 68,3 78.5 87.7 
8 Biel) -O0cO™mil5e9u G0ol 9603 
9 6405 75.9 83.5 94.8 10h. 
10 7152) ese. Wool. eee. 5 lita) 
pai T1168 © 90c 9826 LO.2e) 120-55 
ie Blo S 97.0 9 eon 110.6 12957 
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TABLE 2 (continued) 


Confidence Level 
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5961 
63.6 


90 


11.5 
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Minimum Number of Successes Required 
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0 
2307 
31.5 
38.8 
45.8 
52 06 
5902 
65.8 
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APPENDIX X 
COMPUTING TECHNIQUES 

In computing the terms of the |_(q) expression, two valuable 
techniques were devised. The "reliability coefficient" refers to 
the coefficient in Z that is associated with each exponential term 
in the L.(q) expression. 
Term Code Generator: 

A term code is a sequence of positive integers Py)» Po» P3y coos 
P,» Which, when interpreted in a particular manner, represents the 
calculations nbebesary to compute a given term of a reliability 


coefficient. For example, consider the term: 


1 3 1 1 
(Zo), (2yn%Q), (Ayr, (Sg =%,) 
a 33 et 1! 
which is one of the 32 terms in the reliability coefficient for F=#6, 
The term code for this term is 1, 3, 1, 1 which is merely a listing 


of the successive powers. The formula for calculating the term is: 


P} c Pp? Z P3 Pes Pht 
(2) : (2p, -Zo) : (2p) +272 py) : 2p, *P 9's “Pa *p eee 


p  ! Po! P3! P),* 








where the .... implies we continue this process until all the p,'s in 


the code have been used. There are oF-1 


term codes associated with 
a given failure level F, and they represent all the possible perm- 
tations of positive integers that sum up to F. An algorithm for 
generating all the term codes for a given failure level is: 

1. The first code consists of one integer equal to F. 

2. The last code consists of F integers equal to one. 

3. Given any code Py» Pos see» Prizes Pus Wy lt aoe p fis 


the next code is pj, Pos ees Pol? Parts Pye 





Rule 3 Says subtract one from the last integer not @qual to one, then 
follow this by only one integer. This last integer P, is naturally 
always chosen such that the sum of the p's equal F. Example: I¢ Fe), , 


then this algorithm produces the 8 term codes, 


ks 3,1; 2523 2,1,1; 


existing term code and change it into the next code if possible, If 
the code was already in its final form, all ones, the subroutine exits 
to an alternate address. The term code &enerating routine allows us to 
have only one code stored in the machine at any one particular time, 

If all the codes had to be stored in the machine at the same time, the 


Problem would not have been feasible, 


integral power. The technique used is quite dependent upon the fact 


that we have the binary representation of the power, If 


p* bo by 2*b 2+) ,274 eee *b,2", 
where 

b, = Oor WA 
then Se =F °0 ogee 2 a ape eee a 


Thus we Benerate the sequence a, a, a’ 7 sites aon as far as 


needed, then multiply together the Sub set corresponding to b,=1 which 
Zives a. For example, to compute Ses write 11=(1011)., then compute 
3, 3°=9, 34m81, 39656 

finally 3°'= (6561) (9) (3) = (6563) (27) = 177,147, 
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aa o = a 
large aetea) powers, and is considered to be a significant time 























